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•ABSTRACT 

N  items  have  been  tested .    Attempts  are  made  to  correct  those  failure 
modes  that  occur;  the  probabilities  that  these  attempts  are  successful  are 
assumed  known .    The  conditional  distribution  of  the  resulting  true  reliability 
is  derived  and  used  to  construct  observable  limits  which  will  include  the  true 
reliability  with  a  known  probability. 
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CONDITIONAL  DISTRIBUTION  OF  TRUE  RELIABILITY 
AFTER  CORRECTIVE  ACTION 

1.    Introduction 

This  paper  considers  a  situation  in  which   N    items  of  a  particular  sort 

are  tested .    N    of  these  items  work  correctly  and  N-N    fail .    The  items 
o  o 

that  fail  are  scrutinized  and  for  some  (or  all)  the  cause  of  failure  is  deter- 
mined.   Corrective  action  then  is  taken  to  remove  those  failure  modes 
that  are  observed  in  the    N    tests.    The  corrective  actions  taken  may  or 
may  not  be  successful  (in  removing  their  respective  failure  modes  from 
subsequent  items);  no  further  items  of  a  corrected  design  are  tested.    It         ':' .  •'.  .'■•: 
is  assumed  that  the  probability  of  correcting. any  observed  failure  mode 
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is  known . 

The  value  of  the  true  reliability  of  a  system  after  attempts  have  been    -.. 

'  ■■/■ 

made  to  remove  the  failure  modes  that  occur  in   N    independent  tests  of 

/■  ■.> 
the  system  is  a  quantity  of  vital  interest.    This  true  reliability  is,  of 

course,  a  random  variable,  a  quantity  whose  value  depends  upon  the  out- 
come of  a  chance  experiment.    Since  no  tests  of  the  system  are  assumed  -^Jr, 
to  have  been  made  after  the  correctional  attempts,  there  is  available  no 
direct  experimental  evidence  on  the  reliability  value  finally  attained .  How- 
ever, assuming  we  have  available  the   results  of  the    N   tests  of  the  system 


:  i    . 


*& 


and  that  we  know  the  probability  that  any  occurring  failure  mode  is  corrected,'    '•"..*■' 
it  is  possible  to  construct  the  (conditional)  distribution  of  the  true  relia-   .  ,  , 

bility,  and  to  explore  this  distribution  for  possible  meaningful  statements  ; 

[•••'■■■  • 

that  can  be-  made . 

■ 

The  paper  "Estimating  Reliability  After  Corrective  Action"  defines  p 

O  :.,.-. 

as  a  measure  of  current  reliability  and  then  goes  on  to  discuss  and  compare;      .■■■■ ..' :..; 

* 
estimators  of  the  average  value  of   p      ,  called  the  mean  reliability.    It  is 


stressed  by  the  authors  that  the  paper  is  concerned  with  estimators  whose 
properties  are  to  be  studied  prior  to  the    N   tests  having  been  performed, 
thus  justifying  the  concern  about  mean  reliability,  an  average  taken  over 

all  possible  outcomes  of  the   N   tests  .   An  approach  such  as  theirs  is 

•  '"'      '.:,-•      ;  .■-.■■.■■■■'■■         '      ■ 
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undoubtedly  of  interest  in  the  early  phases  of  development  of  particular 
types  of  item. 

It  would  seem  that  an  equally  important  problem  can  be  phrased  in  a 
rather  different  way.    Since  the  final  estimator  of  achieved  reliability 
(subsequent  to  the  corrective  action)  is  reasonably  a  function  of  the  number 
of  failures  of  various  sorts  that  occur  in  the    N    tests,  the  conditional 
distribution  of  true  reliability  (conditional  upon  the  outcome  of  the    N 
,  tests)  might  be  expected  to  yield  some  valuable  information.    This  condi-     4 
tional  distribution  is  exactly  known  (in  some  senses)  at  the  time  the  actual 
estimator  of  achieved  reliability  is  to  be  evaluated .    This  paper  gives  the 
conditional  distribution  of  true  reliability . 

This  conditional  distribution  of  true  reliability  can  be  used  to  con- 

l 

struct  a  conditional  confidence  interval  for  the  achieved  true  reliability, 
based  upon  the  results    of  the    N    tests.    This  conditional  confidence 
interval  gives  a  number,  call  it  Z   ,  such  that  the    probability  is  at  least  .'.. 
1  —or  that  the  true  reliability  is  as  large  as  Z    (or  larger)  .   As  such,  it 
reflects  both  the  information  contained  in  the  results  of  the    N   tests  and 

■ 

'     -    the  assumed  knowledge  regarding  ability  to  correct  observed  failure  modes . 
As  will  be  seen,  the  conditional  confidence  interval  statements  that 
are  given  involve  some  generally  described  functions.    It  is  expected,  but. 
not  yet  investigated,  that  for  some  very  special  types  of  these  functions 
relatively  tight  probability  statements  can  be  made.    That  is,  by  adjusting 
the  functions  involved,  it  seems  probable  that  the  probability  of  exceeding 
Z     might  be  made  quite  close  to  1  -or,  rather  than  possibly  being  quite  a  \  • 
bit  larger  than  1  -  a  . 

2.    Conditional  distribution  of  true  reliability. 

N  systems  are  to  be  tested.    Each  system  either  operates  successfully 
(with  probability  p  )  or  it  fails  to  operate  successfully  (with  probability 
1-p  ) .   A  system  which  does  not  6perat.e  successfully  can  fail  according 
to  anyone  of  K   different  modes  (with  probabilities  of  occurrence  equal 

'  .   '■■;.• '."  "  ■  fW  •       vv',2,*'  ■{'■;&  \  ;n''v;  .        ■    :'     ,      .  ■'    ';      '.'  ■:■ 
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to  q . ,  i-1 ,  2  ,    . . . ,  K  )    . 


Thus    I  qt  =  l-po 
1=1 
In  writing  the  conditional  distribution  of  true  reliability ,  we  can  choose 
to  represent  either  all    K  possible  failure  modes  or  to  represent  only  those 
R  modes  that  actually  occur.    If  we  make  the  first  of  these  two  choices , 
then  in  the    N    system  tests  we  may  not  observe  all  K   modes  .    Letting  a. \'- ■  .' 
be  the  known  probability  of  correcting  the  i      failure  mode,    i=l,  2,  . .  ,,K,  , 

'  .it'.i' 

the  probability  mass  function  of   Z,  the  true  reliability,  is  as  given  in    .  y 

th  - 

Table  1,  the  variable   x,  is    1  if  the   i       failure  mode  is  observed  one  or  ::'■■•-. 

l  .;,  ■ , .' 

more  times  in  the   N  tests  and  is    0    otherwise. 
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This  probability  mass  function  is  a  little  unusual  in  that  we  are  assuming 

we  do  not  know  the  values  the  time  reliability  takes  on,  since  they  are 

functions  of   p     and  the   q.'s    but  we  do  know  the  probabilities  with 
o  i 

Which  these  unknown  values  occur. 

We  can  easily  derive  the  moment  generating  function  for  this  distri- 
bution by   examining  the  terms  we  get  in  expanding  such  a  function  as 

W  (a2  +  b2»    "•(ak  +  bk)- 

If  we  form  the  sum  defining 

:.*2(t)    =    E(etZ) 
•      this  sum  contains  all  the  terms  (and  no  others)  in  the  expansion  of 

i=l      >  1  i  ■•,  i  s   . 

Thus,  the  moment  generating- function  for  Z  (in  this  formulation)  is 

K 


*zw"  et\;'(axe«iV:aV{) 

"  1-1       1  I  ■.  ,•* 


Evaluating      4    (0)    and      f_(0)    we  find 
Z  « 

K    :■ 

m  =  p0  +X-Viqi  =  po  ' 

i=l 

K 


E[(z-E(25?]=Zai(1-ai)xiqi2 


i=l 

(Both  of  these  expectations  are  conditioned  upon  the  results  of  the    N 
tests)  .    Thus',  the  measure  of  true  reliability  (p  )  mentioned  in  the  paper 
by  Corcoran,    Weingarten  and  Zehna  is  in  fact  the  mean  value  of  the 
conditional  distribution  of  final  reliability/  If  we  average  this  mean  value 


\  \ 


1 
■ 


over  all  possible  experimental  outcomes,  we  arrive  at  mean  reliability, 

the  quantity  they  were  estimating  .    Especially  since  the  actual  estimation 

takes  place  only  after  the    N    tests  have  been  performed,  it  would  seem 

* 
reasonable  to  try  to  estimate  p     (or  some  other  property  of  the  conditional 

distribution)  rather  than  something  influenced  by  events  that  are  known  not 

to  have  occurred,  when  the  estimation  actually  takes  place.    The  second, 

simpler  (and  more  natural)  representation  of  the  conditional  distribution  of 

true  reliability  is  given  by  considering  only  those  failure  modes  that 

actually  occur  in  the    N    system  tests  (rather  than  considering  all  possible 

failure  modes  that  could  occur)  ,    Let  Z    be  the  true  reliability  (after  the 

N  tests  and  corrective  action)  and  assume  that   R   failure  modes  occur. 

Then  the  conditional  probability  mass  function  for   Z   is  as  given  in  table 

one  above,  where  we  set  x   =  1,  for  i=l,  2,   . . .,  R,  and  set  x.  =  0,  for 

i=  RtI  ,    * » •  i  K • 

Then  the  moment  generating  function  for  Z  (in  this  revised  situation)  is 

■  •■.*■'*  ■'.  ■  .•'.■••'  • 

♦_«  =  etpo  5 .r«.>i > (i-a.) \  i '•.."': 

The  mean  and  variance  of  Z  are 

V  " ■■''':;     EW'-P0   +   Iaiqi 

i=l 

2  R 

B[(Z-E(2J)    ]=IVl-ai)qi2     . 

i«i 

;*-"■•.   We  would  like  to  know  the  actual  value  that  the  true  reliability  has 
taken  on,  after  the  corrective  action  has  been  completed;  this  value  is 
a  random  variable  whose  conditional  distribution  is  given  above.    Since 


■••  •      . 

.■    .  _ 

• 

' 

. 

■ 

•  '  % 

,                               •> 

••  i 

, 

■   , 

*      ' 

..* 

-    :v\ 

'4       • 

^ 

.     ;  > 

.. 

• 

•  .'■'. 
.  -     » 

,     ■ 

• 

■ 

.     •' 

s 

..  • 

.    1 

1 , 

,* 

■ 

■    •   . 

-  •. . 

• 

•■ 

':'"-  '.' ■': 

'.  ■  ■  ■ 

•»    , 

'    '   '  ..■ 

! 

' ,  I .   ' 

.'.- 

/ 

*     »    .    -■ 

■ 

-1 

.  i 

< 

,,.,-' 

, 


v  '.  .. 

■ 


:the  actual  value  cannot  be  observed,  the  natural  substitute  to  turn  to  is 

estimation  of  various  properties  of  the  conditional  distribution  of   Z  . 

' 

The  question  of  point  estimation  in  general  will  be  addressed  first  and 


then  the  idea  of  interval  estimation  of   Z  will  be  investigated . 


3 .    Point  Estimation 


■I      • 


The  most  frequently  estimated  parameter  of  a  probability  distribution        \ 

is  undoubtedly  its  mean.    Accordingly,  if  we  were  to  make  a  point  esti-  . 

'■  ;  ■■ 
mate  of  some  property  of  the  conditional  distribution  of     Z,    the  most 

logical  candidate  to  consider  first  might  be  the  mean  of  the  distribution . 

We  have  available  the  results  of  the    N    system  tests  for  making  such  an    ■;      . 


•v 


estimate  and  thus  could  consider  any  estimator  which  is  a  function  of 

N   ,N1/N0;'ND.    The  estimator  \  '-v-;- ::-"'.!; ," ' 

p     =      o      +  \  a 

1  N  .^  i    N  .:.  ' 


is  in  fact  an  unbiased  estimate  of  p     ,  averaging  over  all  possible  out- 

o 

comes  of  the  experiment.    However,  since  we  are  committed  here  to  con- 
sidering only  properties  of  the  conditional  distribution  of   Z  ,  it  would 
be  no  more  than  reasonable  to  consider  the  properties  of  estimators 
averaging  only  over  those  experimental  outcomes  such  that  the  distri- 
bution of   Z   remains  unchanged .    If  we  do  not  take  only  such  conditional 
averages  into  account,  then  since  the  conditional  distribution  of   Z  may 
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change  so  may  the  quantity  to  be  estimated  and  we  are  effectively  esti- 


mating something  different  from  what  was  intended .    The  conditional 


■'..■.' s  .. 


distribution  of   Z   remains  unchanged  so  long  as  the  failure  modes 
observed  are  unchanged,  no  matter  how  many  times  they  are  observed. 
Thus  we  would  like  to  average  only  over  those  experimental  outcomes 
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such  that  the  observed   failure  mode's  still  occur  and  we  are  led  :  ' 


.  • 


to  defining  the  eventA(on  the  space  of  all  possible  outcomes  in  the    N 

system  tests)  to  be  the  set  of  outcomes  such  that  N  >0 ,  N  >0 ,  . . . ,  N  >  0 , 

12  R 

where  failure  modes.  1,  2    . . . ,  R  are  the  ones  that  are  observed  in  the  tests  . 

If  A   occurs ,  the  conditional  distribution  of   Z   is  fixed.    In  discussing 

•     ..    •  ■       i    j. 

properties  of  point  estimators  we  shall  make  use  of  conditional  expecta-  ' 

...,;  <.'■.  ;>& 
tions  only,  in  accordance  with  the  discussion  just  given.  ■*  .  ' 
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As  was  mentioned  above,  the  estimator 

*  *..  * 

R 

p,    =        o   +    )   a.N. 
.1                      L    x   i 

i=l 
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is  an  unconditionally  unbiased  estimator  of  p    (since  E(NJ)  =  NqJ  .    How- 

o  i  i  ..",'■>•' 

ever,  it  is  not  a  conditionally  unbiased  estimator,  as  will  be  shown  below.  .     < 

For  simplicity,  suppose  that  we  perform   N   system  tests  and  observe  "•■■'.'■ 'V  V. 
only  2  failure  modes  .    Define  .        ■'../• 

A={(N   /N.,  NJ:    N.>0,  N9>0[  .         - 

■  .,1        O         12         .  1  .  Li 
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Without  a  great  deal  of  difficulty  we  find  (again  k=  N-i-j) 

N-2     N-l-i         N 

e(n,|a>(a)  =  £       I    i0lOpM««ak. 


.     ,   ■    :       =    Np    P  (A)     ,       ,  )      ; 

i=o     j=i 
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=    Nqx     {l-(po+q/M} 


N-2     N-l-i 

ij  ''I? 


=>^{1.-WN"1}-    V 

then,  combining  the  above  results  we  find 

"••  •       • .  ■  •  '        ■  ■   ,      ■     • 

+  a2q2  ■{i'-<Po+,,2>N"1}' 


o  •  nl  ^2 


■  • .  •  ,  ■ . 


/  •'. 


thus  Brpi*v-p  +  ^U-w^j-^d-v/'1} 

o    1  o     Z  o  .;<■.-. 

.,.•■_ .  .  ..,,,• 

It  would  appear  to  be  a  hopelessly  complex  job  to  add  a  quantity  to  p. 

to  correct  for  its  bias  (in  estimating  p       conditionally);  possibly  it  could  ;■     ,  ■  . 

not  be  done.    Since  conditional  unbiasedness  seemed  so  difficult  to 

'  ■  •  ■ 

achieve,  the  investigation  of  point  estimators  has  initially  stopped  at 


'  / 


this  point.    More  thought  should  be  given  to  what  parameters  of  the 
conditional  distribution  are  of  particular  interest  before  much  of  an 
attempt  is  made  to  construct  "good"  estimators  of  them.    In  passing ,  in 

the  case  of   R   failure  modes  occurring,  it  is  conjectured  that 

••■..-.  -      ! 

R  P  R     R-l  R     ,  ~  j  • 

E  [(J,'-   |  A  >(a)  =    Nq,    (i  -  I  (p o+  ^)N-X+  V  •  l(Po+  £  q   ^  ,:. 

rn=r  j=1         n=mSl  m=l  j=1  ... 

mA  j*n  E&1'  j^m '>;<;;/; 

j/n-  ■.;*-■ 


for  1=1 ,  2  ,  . . . ,  R . 


»  .» 


•"'  ./     These  values  can  (possibly)  most  easily  be  derived  by  taking  derivatives 

of  P(A)  with  respect  to  the  parameters    p   ,  q. ,   ...  q    and  solving  the       ';'.■•-   V. 

.OIK  .    ••  <     ''   '• 

'resulting  system  of  equations  for  the  conditional  expectations  of  interest.      '   ^v" 

.'•'■•. 

•/■    »  ,  '  • 

;  4.    Interval  estimation.  ',;.:    .' 

.  ■  '.    ■  ■  •  •  ■'<■"■'.'/ 

■  •  ,  •••■<•    '    ' 

An  apparently  more  fruitful  avenue  of  investigation  is  that  of  interval       ;    ;V.... 

estimation  of  the  true  reliability   Z    .    Since  we  know  the  probability  distri-  • 

:>  '":-'•  '■■',■ 


• 


bution  of  Z   it  should  be  easy  in  theory  to  find  a  point   b    such  that       \  . s- 


J        <    • 


■■■ 


P  (Z>  b)  ^  1-cY 

and  thus  the  interval  (b,  1)  would  constitute  a  100  (1-a)  %  confidence  "' 

•  •  •      •-•  .'■  ,  •   ■'. 

interval  for   Z  .    The  reason  that  we  cannot  immediately  find  the  value  b,      /:    ,  ' 

of  course,  is  we  do  not  in  general  know    p  '     q, ,   . . . ,  qT,  and  thus  do  .. : ,'.'•- 

o       1  K 

not  explicitly  know  the  values  (nor  even  the  ranking  of  them)  that  the 

.....:.  •  "'  •'"   '/     '•    "' 

true  reliability  will  take  on.    However,  there  are  some  interesting  lines 

•  .      ■  ,  -  *  ■ 

of  reasoning  that  can  be  explored,  leading  almost  to  confidence  intervals 

for   Z   (one  approach  leads  exactly  to  confidence  intervals  of  the  above    ',   .-".' 

sort)  .   We  shall  consider  two  separate  cases,  the  first  assuming  no       ,)''<  . . :. 

information  whatsoever  about  p  '/q. ,   . . . ,  q    and  the  second,  assuming 


h  • 


that  we  have  available  a  ranking  in  order  of  magnitude  of  q  ,  q9  ,   . . .  q    , 
determined  independently  from  the  current  set  of  tests  .    Within  each  of 
these  we  shall  discuss  both  conditional  and  unconditional  confidence  j 

intervals  for   Z  . 


In  the  event  that    p   ,  q, ,  q0   . . . ,  q_  are  completely  unknown ,  the 


o'  nl'  "2  •"'  "R 


i 


.• 


values  and  ranking  of  values  that  the  true  reliability  takes  on  are  unknown.  ."; 
However,  due  to  the  definition  of  the  probabilities  of  successes  and 
failures  occurring  there  is  a  natural  partial  ordering  that  can  be  exploited  '  . 
to  construct  conditional  interval  statements  about   Z  .    Thus,  since  ..--''. 

.  p    ^0,  q.^0,   . . .,  qR  >  0,    we  know  that 

po<Po  +  ql<Po  +  ql  +  q2<  •'•<Po  +  ql  +  •••  +  qR 

Po<Po  +  q2<Po  +  q2  +  ql<  •••<po  +  V  •••  +  qR, 

..  and  so  on .    In  fact,  it  can  be  shown  that  the  true  reliability   Z   may  take 

R 
,  on  any  of  2    (conceivably)  distinct  values  if   R   failure  modes  occur.- 

p    +  q.  will  precede  2      -1  of  these,  for  all  i,  and  is  indeterminate  with 

0  R-l  r     '     :    ; 

respect  to  2        of  them.    More  generally,  p    plus  r  q  's  will  succeed  2  -i    .    ■ 

R-r  °  : 

•  values  ,  precede    2       -1  values  and  is  indeterminate  with  respect  to  the 


,i' 


i 


,R-r  ,v  ,„r 


■ 


< 


.,  ■■■ 

<■■■■    ■:  <■ 


v\    !■    "       ■.■.::■>■■■  :>•    .:■    ••■ 


remaining  (2-1)  (2-1)  values.  . 

This  natural  partial  ordering  can  be  used  to  make  statements  such 

as  k    •  '  •  ■ . 

P[^*alta(p0'+qlt  P0  +  q2.    •••.P0  +  qR)]  '" 

PIZamin-  VVq2'po+ql"^3'.  •••'Po3'qR-l+q2)]  •       '•' 

»         R 


i=l         J"l 


-'  .i  ■ 
etc .    It  if  should  happen  that  one  of  these  right  hand  sides  is  equal  to 

a  confidence  level  of  interest,  then  we  almost  have  a  confidence  interval .      :  •-. 


.'I  10.     '-h    : 

'  ;.«■ 

•   '•  /  f  : 


\    ■ 


Almost,  because  we  still  do  not  know  p    and  the  q.*s  and  thus  would  have 
to  estimate  them  in  order  to  have  some  idea  where  the  minimum  value  in- 
volved might  fall .    But  in  making  use  of  such  an  estimate  we  would  no 
longer  have  an  exact  probability  statement  about  the  interval  containing  Z  • 

However,  if  we  think  of  the  compound  experiment  consisting  of  the  N 
system  tests  and  then  the  corrective  action,  the  reasonable  probability 
measure  to  use  for  the  compound  experiment  is  constructed  by  multiplying 
together  the  measure  that  applied  to  the    N    system  tests,  times  the  conditional 
measure  applicable  to  the  corrective  action  taken  (conditional  only  in  the  sense 
that  the  experimental  outcome  dtermines  the  corrective  action  to  be  taken)  . 
Using  this  multiplicative  rule  enables  us  to  make  statements  such  as 


>Tt  WBWWWWWW  *  'vrviT"* 


I.'"**"'  .P|_min  (P0+Qr   ...,  P  +q^>f(N   ,N1#..wN^.,Zimln(p  +q|.^.,p  +q    M-jj  ■••' 

■   : 
\  m  p  [min  (pQ+q1 ,'...,  pQ+q^ ,  >  f(  NQ ,    . . . ,  N^    |  aV 

•  p[  Z  *min  (Pq+Qj/   •••>,  PQ+cy  I  AJ 


■    ■ 


■  ,-.•  4' 


■  ■  ■  . 

".'<  -.  ■•' 

^  -  . -..■  .■■•■...■:; 

where   A   is  the  event  defined  above .    The  results  of  the    N    system  tests 
- 

are  available  to  evaluate  f  (N   ,  N. ,   • . . ,  Nn  )  occurring  in  the  first  of  these 
*   \  o       1  R  .         v    . 

$'-.  -two  probability  statements  (this  is  just  a  conditional  multinomial  probability     V      > 


■■■  i 


>. 

.■;.•.' 


•  '■ 


statement)  while  reasoning  such  as  the  preceding  may  be  used  to  evaluate 
the  second.    Their  product  gives  us  a  statement  that  is  somewhat  similar 


to  a  conditional  confidence  interval;  this  product  can  be  used  to  construct 

■  .i 
a  lower  bound  confidence  interval  as  follows .    Let   g    be  a  function  of  the 


unknown  parameters,  let    f   be  a  function  of  the  observable  random  variables 


*■• 


■ 


■• 


N    ,  N, ,   . . . ,  N_ ,  and  let   A   be  the  event  that    N.  >  0 ,  N-  >  0 ,    . . . ,  NL  >0  . 

o      .  i  k  l  z  R  ■ ".•„ \- 


Then  a  conditional  confidence  interval  for  Z  would  be  a  statement  such  as 


... 

•      !    .     v  , 


P  (  Z>  f|A)  si  -a  .,  ■    • 
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.-••>■ 

"'     .,'      ••' 

,   ,:-       .■ 

. 

■ 
.... 


The  statement  we  are  able  to  make  is 

P  (Z>g,  g>f  |  A)    =    P  (Z->g  |  A)  P  (g>f  |a| 

=  1  -a 
Since  the   set      relationship  {  Z  >,g,  g>  £  }  c  {  Z>f }  must  hold,  we  can 
say 

P(Z>f|A)^p(Z>g,g>f|A)  and  thus  get  a  lower  bound 
on  the  probability  that  an  observable  interval  contains    Z  . 


v" 


Unconditional  confidence  intervals  would  possibly  not  be  of  much 
interest,  for  many  of  the  same  reasons  given  previously  regarding  expecta- 
tions averaged  over  all  possible  experimental  outcomes  .    Since  we  would 
not  be  constructing  the  interval,  presumably  ,  until  after  the    N.  system 
tests  are  completed,  we  would  be  more  interested  in  the  conditional  •     v 

measure  of   Z   than  we  would  be  in  the  unconditional  measure.    Even  if  we 
had  the  interest,  it  would  appear  to  be  impossible  to  construct  an  uncondi- 
tional  confidence  interval  for   Z  ,  since  the  probability  that   Z  exceeds 

some  function    f  of  the  observable  random  variables    N   ,  N, ,   . . . ,  N„  . 

o       1  R     .        v   . 

is  going  to  depend  upon  what  values  of  the  form    p   ,  p  +q. ,  p  +q9 ,  etc., 

are  exceeded  by  f;  given  no  information  about  p   ,  q, ,   . . .,  qn,  we  are 

ol  R  ' 

not  able  to  determine  which  of  these  values  are  and  which  are  not  exceeded 
by  f .    Thus  we  cannot  logically  derive  an  unconditional  measure  of  the  ' 
probability  that   Z   exceeds    f.        ,   ;      .      ;      \  \< 

Suppose  we  are  given  that 


qi>Q2>  •'•>qR'- 
Then  we  would  find  that  again   Z   can  take  on  any  of  2     (conceivably) 


■. .  ■> 


distinct  values,  but  now  p  +q    is  indeterminate  with  respect  to  only  .    . 

R-l  ^  R-2  ' 

2      -R  of  them,  p  +q    is  indeterminate  with  respect  to  2       -R+l  of  them,  :.  £  ; 

etc.;  in  general,   p  +q   is  indeterminate  with  respect  to  2  "  -(R-i)-l  of 
■■    o     i 

the  othf /  values,  for  1=1,2,  .../R-l.    The  position  of  p  +q^  is  completely  : 


12 


determined  with  respect  to  all  the  possible  values  .    Similarly,  we  find 

that  the  position  of  p  +  q+q9    is  andeterminite  with  respect  to  ■ 

2R~^-  /^"3  ^  -  (R-3)  -1  values ,   p  +q.+q~  is  ^indeterminate  with  respect 

to  2        -  TRo4  )  "  (R~4)  "1  values,  and  so  on.    The  assumed  ranking  of 
the  q  's  thus  leads  to  a  more  definite  ranking  of  the  values  of   Z  ,  which  ; 
in  turn  would  imply  that  we  have  a  much  wider  choice  of  values  for  state-- 
ments  such  as 

P  (  Z  >  g  |  A  )    , 
where   g    is  some  function  of  the  unknown  parameters .    Thus  we  could 
construct  confidence  intervals  for  a  much  larger  choice  of  probabilities  . 
Exactly  the  same  type  of  reasoning  as  that  outlined  above  would  lead  to 
lower  bounds,  on  the  conditional  probabilities  that  particular  intervals 
cover   Z  .    Unconditional  statements  would  appear  as  impossible  of  attain- 
ment here  as  in  the  preceding  case,  for  exactly  the  same  sort  of  reasons . 

5 .    Topics  for  further' research . 

The  conditional  multinomial  probability  statement  mentioned  in  section 
4  above  may  or  may  not  be  a  simple  matter  to  derive.    The  feasibility  and 
explicit  method  of  attaining  such  a  statement  should  be  spelled  out  in 
detail . 

The  assumption  that  the  a  *s  are  known  (the  probabilities  of  removing 
observed  failure  modes)  may  not  be  realistic.    The  affects  of  these  quanti- 
ties being  unknown  should  be  detailed.    In  many  cases  it  would  seem 

plausible  to  assume  p   ,q  ,  . . .  ,q    known  and  a  ,  a    ,  . . .  ,a    unknown;  the 

O      1  K  1        i>  K. 

affects  of  this  change  should  be  investigated . 

It  might  prove  profitable  to  replace  the  probabilities  of  correcting 
observed  failure  modes  by  the  reliability  of  the  replacement  part  (or  design 
change) .    That  is,  if  a  design  change  is  made  then   a     is  essentially  the 

probability  that  the  reliability  of  the  change  is  1;  1-a   is  the  probability    . 

i .    .    . 

.  .  .  '  •  .   •  .•  • 

'      •  ■.*•''.■ 
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that  the  reliability  is  less  than  1  (but  no  indication  of  how  much  less 
than  1)  .    Rather  than  include  the  parameters    a     in  the  model  it  might 
prbve  better  to  use  the  parameters    b  ,  defined  to  be   the  reliability 
of  the  changed  item  or  portion  of  the  design.    This  would,  of  course/ 
,   allow  final  reliability  after  corrective  action  to  decrease  rather  than  only 

'    to  increase  as  in  the  present  model. 

■ 

The  whole  basic  model  for  reliability  growth  might  be  better  if 
. '.'    structured  in  some  different  manner.    The  suggestion  made  in  the  last 
paragraph  is  one  possible  restructuring;  undoubtedly  many  others  could 
','•'      be  brought  to  mind.    The  restructuring  should  keep  in  mind  simplicity  of 

■      .  .  '  ■  •   ■'  ;■ 

\    ,    approach,  ease  of  computation  and  estimation  and  yet  remain  as  realistic  . 

:■  as  possible. 

■     ••  .       \  '.      '  -  •     -        .  .-.•••    ...',■    V 
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